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Sum of Squares Programming 


Establishing nonnegativity of functions is critical in nonlinear system 
analysis, e.g., a Lyapunov function V for x = f(x) must satisfy 


V(x) > 0 Vx 40 (1) 
=VVix)' f(x) > 0 Vx. (2) 


For f(x) = Ax and V(x) = x'Px, the conditions above are simple 
matrix inequalities: 


PSO, =ATP—=PA>G 


How can we check nonnegativity when f and V are more general 
polynomials? 


Sum of Squares (SOS) Polynomials 
A monomial is a product of powers of variables (e.g., m(x) = x7Xx2) 
and its degree is the sum of its exponents (¢.g., 3 for m(x) = x{Xx2). 


A polynomial is a finite linear combination of monomials and its de- 
gree is the maximum degree of these monomials. 


Example 1: The polynomial 


gly) = a, —< Days + at + xi xo — exe + 6x5 (3) 
has degree 4. 
Definition: A polynomial p is a sum of squares (SOS) if there exist 
polynomials 91,--- ,g, such that 
‘ 
ee (4) 
i=1 


A SOS polynomial p(x) is nonnegative for all x. The converse is not 
true: there exist nonnegative polynomials that are not SOS. 


The polynomial q(x1,x2) in (3) is SOS because it can be rewritten as: 


1 2 1 2 
e=a4 5 (2x7 + x1X2 3x3) 5 (3x1x2 + 3) : (5) 


You can verify the equivalence of (3) and (5) by multiplying out terms 
in (5) and matching them to those in (3). 


How a SOS decomposition like (5) can be obtained is discussed next. 
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SOS Decomposition 


Let z(x) be the vector of all monomials of degree < d in n variables?: * The length of this vector is Ijy,4) := 
2(x) © [1 x1, X2) <6 0, Xn HF, XX, 00. X4]F. ( . 
Then any polynomial with degree < 2d can be rewritten as 
p(x) = 2(x)'Qz(x) (6) 
where Q is a symmetric matrix. 


Example 2: Let p(x1,x2) = 2x7x} which has degree 4. With n = 2 
and d = 2, 

z(x) = [1, x1, x2, coe x1X2, ole (7) 
and (6) holds with either 


0 0 0 0 
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Thus, the choice of Q is not unique. 


Theorem: A polynomial p with degree < 2d is SOS if and only if 
there exists Q = Q’ > 0 satisfying (6). 


Proof: (only if) If p is SOS then, by definition, p = L/_, g? for some 
polynomials g;,i = 1,---,r. Write gj as: 


Bi(x) = Cz(x) (8) 


where C; is a row vector of coefficients. Then g a ge CiCe and 


r r 
t= Vg =z! (sera) % 
i=1 i=1 
1 1 
Q>0 
(if) Given Q = Q'> O satisfying (6), decompose Q as Q = C'C 
where C has as many rows as the rank of Q, say r. Then, 
r 
Q=Cca=y cc 
i=1 


where C; is the ith row. If we define g; as in (8), then 207 = re) oe 


Since Q is not unique, not all Q satisfying (6) will certify SOS. In Ex- 
ample 2 above, Qi; > 0 but Q> is indefinite. We need to characterize 
the set of all Q satisfying (6) and search for a Q > 0 in this set. 
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Parameterization of all matrices Q satisfying (6): 


Find a particular solution Qo such that 


p(x) = 2(x)" Qoz(x), 


and find a basis of symmetric matrices Nj, j = 1,2,--- ,K, such that3 > There are “all"inal +) 


matrices. 


— Tin2q, such 
z(x)"Njz(x) =0 forall x. (9) 


Then we can parameterize the set of all Q satisfying (6) as 


K 
Q= Rot DAN; A; ER, 
J= 


and p is SOS if and only if there exist A;,--- ,Ax such that Q > 0. 


For n = d = 2, z(x) is as defined in (7) and a basis as in (9) is: 


Coo 6 4 0000 -1 0 
00000 0 0010 00 
y-{ 299299 Of ,_} 0100 0 0 
00000 0 0000 00 
00000 0 1000 00 
10000 0 0000 00 
0 0000 0 000 -1 00 
GC @ e601 C20 6 0: % 
ma{® ©9091 Of y_} 000 0 0 0 
0 0000 0 I oO. 0° OB 
(i 01. eH « 000 000 
6 =t0 OG Oo 000 000 
0 000 00 000 00 0 
Oo 0 0-0 <1 6 000 00 0 
0 001 00 000 00 0 
N=!lyo go 10 00] “=|o0 00 00 -1 
0-100 00 000 02 0 
0 000 00 000-10 0 


0 000 0 0 
£40 ot 
0 000 0 0 
2%=1o 902 1 «0 
0 001-1 0 
C4 oe & « 
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Note that Qo # 0, but Qo + 6Ne > 0. Moreover, Qo + 6Ne can be 
decomposed as 


0100 0 -!1 1 0 0 01000 -!1 
0002 1 -3 0 i 0 0002 1 -3 
00003 #1 0 0 5 00003 #1 


which explains how the SOS form (5) was obtained. 


Synthesizing SOS Polynomials 


With the method above we can numerically check whether a given 
polynomial function V satisfies (1)-(2). However, in practice, it is 
more important to be able to search for a V satisfying (1)-(2). This is 
accomplished by synthesizing V as a weighted sum of basis polyno- 
mials with weights left as decision variables. 


This leads to the following SOS synthesis problem: 


Given basis polynomials p;,i = 0,1,--- ,m, each with degree < 2d, find 
parameters a1,-++ ,Am such that po + ap, +--+ +4mpm is SOS. 


To solve this problem, find a matrix Q; satisfying p; = z'Qiz for each 
i=0,1,---,m. Then search for a1,--- ,am and A1,--- ,Ax satisfying 


m K 
Qo + ))4j)Qi+ }) A;N; = 0. (10) 
i=l j=t 


This is a linear matrix inequality (LMI) and can be solved numeri- 
cally with standard semidefinite program (SDP) solvers. 


There are also software packages‘ that follow the procedures above +e.¢., SOSOPT 
to automatically convert SOS programs to LMIs, such as (10). 


